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(57) Abstract . 

An image encoding module (35) and an image decoding module (37) provide a method of perfomiing transform coding of an original 
image source (31), where the method serves to suppress or eliminate blocking artifacts. Encoded data (59) are transmitted by the image 
encoding module (35), converted into received data (83), and transfonned into modified data (85) by means of a filtering operation (95) 
utilizing quantization error terms (79). The quantization error terms (79) can be derived from quantization error data generated in the image 
encoding module (35), or can be provided as a look-up table (109) in an alternative image decoding module (101). The modified data (85) 
are converted into reduced-noise image data (89) for reconstruction into a digital image (41). 
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TITLE: METHOD AND APPARATUS FOR 
REDUCTION OF IMAGE DATA COMPRESSION NOISE 

FIELD OF THE INVENTION 
This invention relates to image processing and, more particularly, to a method 
5 and apparatus for reducing the effects of blocking artifacts which can be attributed to 
image data compression noise resulting from quantization-induced error in transform 
image coding processes. 

BACKGROUND OF THE INVENTION 

The image processing procedures of transform image coding is employed in 

10 various applications, including the electronic conversion of photographic images, the 
reproduction of graphical information in a printing operation, and the.transmittal of 
digital image data by means of electronic communication systenis. In such 
applications, the coding is performed ui>on an original source image which has been 
provided as a series of electrical image signals, where each signal corresponds to the 

15 characteristic of an element, or pixel, of the original source image. The electrical 
image signals are converted into a two-dimensional set of numerical values 
representing the source image pixels. A separate set of numerical values is provided 
for each color band used. For example, in a 'joiv' configuration three sets are 
provided, and the u- and v-sets are downsampled, as is well-known in the art, before 

20 further processing is performed. 

These numerical values are commonly configured into a two-dimensiohal 
H X V array of image data terms. Each term in the image data array thus 
corresponds to a particular pixel in the original source image and quantitatively 
describes a feature characteristic of the pixel In a standard display format, for 

25 example, the digital source image comprises an image data array of 640 columns and 
480 rows of numerical values. Transform image coding generates a new set of H x V 
processed numerical values, commonly denoted as reconstructed image data terms, 
which have been computationally derived from the digital source image. The 
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processed numerical values are converted into a new series of electrical signals from 
which a processed digital image can be generated. 

Transform image coding procedures makes use of orthogonal transforms, 
such as the discrete cosine transform (DCT), to convert image data terms into 

5 frequency coefficient terms and thus simplify subsequent processing computations. 
Cosine transform image coding, for example, is an image processing procedure in 
which the digital source image terms are subjected to a two-dimensional forward 
discrete cosine transform (FDCT), the results divided by terms from a quantization 
table, and are entropy encoded by a process such as Huffinan encoding. The 

10 encoded data is then stored or transmitted, usually much more efficiently than if the 
original image data terms had been used. The encoded data is subsequently decoded, 
multiplied by the quantization terms, and converted into reconstracted image data 
terms by the application of an inverse cosine transform (IDCT). A processed digital 
image is subsequently obtained from the reconstracted image data terms. 

15 The orthogonal transforms applied in the process of transform image coding 

are commonly the FDCT and the IDCT. These transforms are applied in accordance 
with an industrial standard established by the Joint Photographic Experts Group 
(JPEG). The ISO Draft International Standard 10918-1 for JPEG is described in 
Appendix A of the reference text, "JPEG Still Image Data Compression Standard," 

20 by William B. Pennebaker and Joan L. Mitchell. In accordance with the JPEG 
standard, a digitized source image is provided as a series of image-data matrices, 
usually formatted as 8 x 8 matrices, and the FDCT is applied to produce a series of 
frequency-coefficient matrices. 

Conversion of an image-data matrix into a frequencyrcoefficient matrix by 

25 means of the two-dimensional FDCT can be expressed in shorthand matrix notation 
■ as, ■ 

S(v,»i) = c X sG,i) X c'^ 

where, S(v,^i ) are terais in the frequency coefficient matrix, sO,i) are terms in the 
image-data niatrix, C is the discrete cosine transform basis matrix, and C is the 
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transpose of C. The two-dimensional FDCT, as applied to 8 x g image-data 
matrices, is given by the equation, 

S{v^fi) = ic,C^iisO\i)cos^{2i + l)^^^ 

where Ck = for k = 0 and Ck = 1 for k > 0. The frequency coefficient terms 

V2 . 

5 are, typically, divided by the quantization terms and the resulting quotients rounded, 
before transmittal or storage. The difference between the quotients as computed and 
the quotients as rounded is a source of computational error induced by the rounding 
operation. This results in image data compression noise which produces blocking 
artifacts at moderate to high compression levels. 

10 . Reconstructed image data terms are obtained by means of a two-dimensional 

roCT opersrtion, which can be expressed in shorthand matrix notation as, 

rO,i) ^ X R(v,ji) X C 

: where r(j,i) are reconstructed inlage data terms and R(v,^) are dequantized frequency 
coefficient terms. The corresponding two-dimensional IDCT, as applied to 8 x g 
15 frequency coefficient matrices, is given by the equation, 

= ic,C^iJ(v,M)cos (2/ + 

Various methods of addressing the problem of blocking artifacts have been 
described in the relevant art. U.S. Patent No. 4,754,492, issued to H. Malvar, 
discloses a method and apparatus for processing n-dimensional digitized signals 
20 containing at least two adjacent blocks of digitized sample values. The apparatus 
taught by the reference comprises a composite spatial operator utilizing basis 
functions similar to conventional DCT/IDCT basis functions, but which are 
characterized by slight extensions into the neighboring blocks in the input signal. 
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U.iS. Patent No. 5,220,616, issued to Downing et al., discloses a method of 
digitally processing images in which an image is compressed by dividing the 
corresponding image array into blocks which are subsequently transformed. 
Boundary discontinuities are smoothed by sequentially scaiming image data 
5 elements at the boundaries with a one-dimensional operator matrix. 

U.S. Patent No. 5,357,584, issued to Yamaoka discloses an apparatus for 
compressing and expanding an image comprising an evaluation circuit for evaluating 
a predetermined compression factor and providing an optimum compression factor 
by comparing blocks of original image data with processed image data. The 
10 : reference evaluation circuit comprises meaiis for performing this comparison in each 
im^e data block, pixel by pixel, to provide block noise data. 

In U.S. Patent No. 5,367,385, issued to Yuan, there is disclosed a method and 
apparatus for processing block coded image data where pixel modification is 
performed by means of low pass filtering to reduce the difference in values between 
15 selected * local' pixels near the borders of reconstructed pixel blocks and 'external' 
pixels near the block borders but in adjacent blocks. 

A method and apparatus for removing blocking artifacts in which a blocking 
artifact measurer is included in the encoder unit is disclosed in U.S. Patent No. 
5,384,849, issued to Jeong. The blocking artifact measurer receives delayed original 
20 frame data and generates a frame data error corresponding to the difference between 
the original frame data and the received restored frame data. 

There appears to be no transform image coding process disclosed in the prior 
art in which the reduction or elimination of blocking artifacts is accomplished by the 
modification of received frequency components. It is therefore an object of the 
25 present invention to provide an apparatus for performing image coding using a 

method that reduces blocking artifacts by filtering received frequency coefficients to 
compensate for the effects of quantization error. 

It is a further object of the present invention to provide such a method and 
apparatus which can be used to reduce blocking artifacts in received 
30 JPEG-compliant image data files. 

-4- . 
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SUMMARY OF THE INVENTION 

The present invention is an image encoding/decoding apparatus for 
performing transform coding by a method in which blocking artifacts are suppressed 
or eliminated. After transform image encoding has been performed, the encoded 

5 data is transmitted and converted into received image data terms which are 

subsequently overlap transformed into frequency coefficients for modification by 
means of a filtering operation utilizing a quantization error matrix. The quantization 
error matrix can be derived from quantization error data generated in the encoding 
unit, or can be provided as a look-up table in the decoding unit. The modified 

10 frequency coefBcients are converted into reduced-noise image data temis for 
reconstruction into a digital image. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The novel features that are considered characteristic of the present invention 
are set forth with particularity herein. The organization and method of operation of 
IS the invention, together with other objects and advantages thereof, will be best 
u understood from the following, description of the illustrated embodiments when read 
in conjunction with the accompanying drawings wherein : 

Fig. 1 is a diagrammatic illustration of a conventional image processing 
system used to perform image data compression by means of transform image 
20 encoding and decoding; 

Fig. 2 is a functional block diagram illustrating the process by which an 
original source image is converted into a reconstructed reduced-noise image by 
means of an apparatus comprising image coding and decoding modules in 
accordance with the present invention; 
25 Fig- 3 is a block diagram illustrating the operational steps performed by the 

image encoding module of Fig. 2; 

Fig. 4 is a block diagram illustrating the operational steps performed by the 
image decoding module of Fig. 2; and 

Fig. 5 is an alternative embodiment of the image decoding module of Fig. 4. 

-5- 
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DETAILED DESCRIPTION OF THE INVENTION 
Fig. 1 is a diagram illustrating a conventional image processing system used 
to perform image data compression by means of transform image encoding and 
decoding* An original source image is converted into a digital source image 
5 comprising image data terms by means of an image digitizer, such as an optidal 
scanner 11 or a video camera 13. The image data terms are either stored by means 
of an image^data disc 15 or similar storage medium, or sent directly to a transform 
image coding unit 21 for conversion into compressed image data. From the 
compressed image data, transform iniage coding unit 21 subsequently reconstructs a 

10 digital image which is sent to an image output unit such as a monitor 23 or a printing 
device 25. Alternatively, the compressed image data pan be stored within unit 21, or 
be archived onto a compressed-data disc 27, or be transmitted to a remote image 
processing system for image reconstruction. 

In accordance with the present invention, an image encoding module 35 and 

15 animagedecoding module37, shown in Fig. 2, perform the image data compression 
and decoding functions of a conventional transform image coding xmit. An image 
digitizer 10 converts an original source image 31 into one or more sets of color-band 
data, each of which is separately identified as a digital source image 33. Digital 
source image 33 is provided to image encoding module 35 as a two-dimensional 

20 H X V set of image data terms. Image encoding module 35 transforms digital source 
image 33 into compressed image data which is transmitted to image decoding 
module 37 by means of a traiismissipn medium 19, \^^ch can be an electronic 
network or other communication system. The compressed image data is received by 
image decoding module 37 which transforms the compressed image data into a 

25 reduced-noise digital image 39. An image output unit 20 converts reduced-noise 

digital image 39 into a reconstructed reduced-noise image 41. In some applications, 
compressed image data produced by image encoding module 35 may be stored or 
archived in an interim storage medium 29, such as a magnetic disc, before being sent 
oh to image decoding module 37. 



wo 96/37077 



PCT/US96/06888 



Image Encoding Module 

The processing operations performed by image encoding module 35 can best 
be described with reference to Fig. 3. Digital source image 33 comprises an H x V 
set of image data terais, denoted by So(z,y). This set of image data terms is divided 
,5 into a two-dimensional array of N ^ N image-data matrices 5 1 as is well-known in 
the art. Each image-data matrix 5 1 comprises terms denoted by s(j,i)> where 
0 < i,j ^ N-1 . The image data terms comprising the image-data matrix located in the 
p-th colmim and the q-th row of the two-dimensional image-data matrix array can be 
detennined from the equation, 

10 Sc,pa4) = soO+Nq, i+Np) 

where 0 < i-fNp < H-1 andO <j+Nq < V-L 

Each image-data matrix 5 1 is transformed by means of an orthogonal 
transformation, at operation 61, into anN x N frequency-cQefficient inatrix 53 
comprising frequency-coeffident terms Sq,p(v,n), in accordance with the forward 
1 5 orthogonal transform equation, 

: Sq,p(v,ti> = C X sq,p(j,i) >^ G- 

where 0 < \x;v < N-1 and C is the forward transfomiation basis matrix. 

The frequency coefficient terms S(v,|x) in frequency-coefficient matrix 53 are 
each divided by a corresponding scaled quantization term Q(v,|x), at operation 62, 

20 where the scaled quantization term is obtained from an N x N quantization table 73 
used in conjunction with a scaling factor 71 , denoted here as k. The degree of image 
data compression performed by image encoding module 35 is proportional to the 
value of scaling factor 71 . The value of scaling factor 71 is also used to determine 
the numerical values for filter parameters and Pk, which are obtained from a 

25 look*-up table in filter parameter set 75. For example, in a preferred embodiment. 

Table I specifies filter parameters ak and pk for image-data bands y, u, and v, wheii a 
yalue for K is given or determined. Filter parameter set 75 is transmitted to image 
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10 



15 



decoding module 37 for use in the attenuation of quantization noise, as described in 
greater detail below. 





Table I 




: Values for a and 3 Given Scaling Factor K 


K 






ttv, pv 


K<8 


0 


0 


0 


8<K<24 


1 


2 : 


2 


24<.kS32 


; 2 


4 . •' 


4 . 


K>32 


3 


6 


6 



Execution of operation 62 produces a two-dimensional matrix array of N x N 
quotient-coefficient matrices 55, where the quotient-coeflficient matrix in the p-th 
column and the q-th row of the niatrix array comprises quotient terms Quq,p(v,^L) 
given by the equation 

Ou (V a) = ^^^^ 

The quotient terms Qu^,p(Vj,|i) are rounded to less precise values, at operation 
63, to yield quantized-coeificient matrices 57 comprising quantized-quotient terms 
Qcq,p(v,|Li) given by the expression 

Qc,.p(v,M) = round(Qu,.p(v,M))==roundf%^ . 

AnN >^ N difference-coefficient matrix 77 is derived at operation 65. 
Difference-coefficient matrix 77 contains difference terms Dcq,p(v,(i) obtained by 
subtracting each quantized-quotient term Qcq,p(V5|Li) in quantized-coefficient matrix 
57 from the corresponding quotient term Quq,p(v,|i.) in quotient-coefficient matrix 55 
in accordance with the equation. 
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E>C^p(v,iti) = abs 



So.p(v,M) 

. e(v,jti) j 



— round 



A series of difference-coefficient matrices 77 are derived, one for each 
frequency-coefficient matrix 53 in the matrix array. The difference-coefficient 
matrices 77 are summed, averaged, and multiplied by a corresponding quantization 
5 term, at operation 66, to produce an N x N quantization error matrix 79 comprising 
terms Eo(v,|i) derived in accordance with the equation, 

where M is the total nximber of difference-coefficient matrices 77 summed. 
Alternatively, quantization error matrix 79 comprises terms Ei(v,|i) derived as 
10 root-mean-square error terms in accordance witii the equation. 



\ q p M 



Each quantized-coefficient matrix 57 is transmission-encoded, at operation 
64, by a process such as zig-zag sequencing with Huffman encoding, to yield a 
transmission-encoded data set 59. Treuismission-encoded data set 59 is then 
15 transmitted to image decoding module 37 via transmission mediiun 19« 

Quantization error matrix 79, filter parameter set 75, and quantization table 73 are 
similarly transmitted to image decoding modiile 37 via transmission medium 19. 

Image Decoding Module 

The image processing operations performed by image decoding module 37 
20 can best be described with reference to Fig. 4. Transmission-encoded data set 59 is 
decoded into a set of received quantized transform coefficients, denoted by 
Srq,p(v,|Li). Each received coefficient Srq,p(V,|i)is mask multiplied by the 
corresponding scaled quantization term from quantization table 73 to produce a 
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mask-multiplied transform coefficient Rqj>(v,|i), at operation 91, in accordance with 
the equation. 

Execution of operation 91 yields a series of N x N received coefficient matrices 81 
5 comprising mask-multiplied transform coefficients R<|,p(v,)Li), where each transform 

coefficient R<,,p(v,|i) corresponds to a quantized-quotient term Qcq,p(v,fi) previously 

processed in image encoder module 35. 

At operation 92, an inverse orthogonal transform is used to convert transform 

coefficients R<,,p(V3|ji) into received image data terms denoted by rq,p(j,i), in 
10 accordance with the inverse transform equation, 

rq,pO,i) - X Rq,p(v,ji) X C 

Each received image data term rq,p(j,i) corresponds to an image data term so(z,y) 
from H X V digital source image 33. Accordingly, received image data terms rq,p(j,i) 
can be formatted into an H x V received image-data set 83 comprising terms denoted 
15 by SR(z,y). This formatting is accomplished in accordance with the equation, 

SR(j+Nq,i+Np) > rq,pO,i) 

where 0 < i+Np < H-l and 0 <j+Nq ^ V-L 

In a conventional image decoding system, received image data set 83 would 
next be reconstracted, at conventional operation 93, to form a received digital image 

20 43, denoted by phantom lines. It is received digital image 43 which commonly 
exhibits blocking artifacts at moderate to high ratios of imajge compression. The 
blocking artifacts result from errors introduced by the quantization of quotient terms 
at operation 63 in image encoding module 35. One procedure employed to solve this 
problem of quantization noise is to reduce scaling factor 71 such that the 

25 quantization performed on the qtiotient terms is decreased and the occurrence of 

blocking artifacts is reduced. However, this approach is undesirable because a lesser 
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degree of image data compression results and the computational resources and 
transmission time required to process the compressed data are correspondingly 
increased. 

The present invention suppresses or eliniinates the occurrence of blocking 
artifacts by means of a corrective process which compensates for the errors 
introduced by the prior quantization operation. In accordance with the disclosed 
method, the terms SR(z,y) comprising received image-data set 83 are modified by a 
filtering process before a digital image is reconstructed. The fihering is 
accomplished by means of the following sequence of operations: i) 
overlap-transforming the terms SR(z,y) of received image-data set 83 into the 
frequency domain to form a two-dimensional array of N x N modified 
frequency-coefficient matrices 85, at operation 94, ii) filtering the modified 
frequency-coefficient matrices 85 to produce a series of filtered coefficient matrices 
87, at operation 95, iii) inverse transforming the filtered coefficient matrices 87 into 
the spatial domain to produce a filtered image-data matrix 88, at operation 96, iv) 
extracting selected reduced-noise terms firom filtered image-da^ matrices iSS, to 
form a two-dimensional H x V reduced noise image-data set 89 at operation 98, and 
v) forming reduced-noise digital image 39 from reduced-noise image-data set 89, at 
operation 99. 

Overlap-transformation of received image-data set 83, at operation 94, refers 
to the process of applying a forward orthogoiml transfomiation to an array of N x M 
matrices which have been obtained ifrom image-data set 83 by an 'overlap' process. 
The image data terms comprising these overlapped image-data matrices are obtained 
fi-om received image-data matrix set 83 in accordance with the equation, 

Vs.rO,i) srO+cos, i+cor) 

where 1 < cb < N-1, 0 < j+cos < V and 0 < i+(or < H. The image data terms 
comprising the overlapped image-data matrix in the r-th colimm and s-th row of the 
overlapped imajge-data matrix array are denoted by Vs,rO»i)- The amoimt of overlap 
used in the overlap procedure is determined by the value of integer constant CO, 
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which is an overlap parameter 84 provided by image decoding module 37. In a 

N 

preferred embodiment, co is set • ^^n be iseen that application of the 

. overlapping process results in a matrix array in which certain rows and coltimns of 
image data terms are common to corresponding pairs of overlapped image data 
5 matrices. For example, 

Vs+i,r04) = Vs.r(j-+-N-a),i) and Vs,r4-i(j,i) = Vs,,(j^i+N-co) 

for 0 < i j < OH-l. By applying a filtering opemtion to image-data matrices which 
overlap one another, matrix-to-matrix discontinuities are avoided and the occurrence 
of blocking effects is suppressed or eliminated. 
10 The overlapped image-data inatrices are converted, by means of the forward 

. orthogonal transformation, into N x N modified coefficient matrices 85 comprising 
niodified frequency-coefficient terms Svs.r(v,jx) given by the mateix equation 

Svs,r(v,Ki) = C X Vs^(j,i) X 

A filtering computation, utilizing filter parameter set 75 and quantization error 
15 matrix 79, is performed upon the modified coefficient matrices, at operation 95, to 
yield N x N filtered coefficient matrices 87, comprising filtered 
: firequency-coefficient terms Sfs,r(v,n), obtained in accordance with the equation 

Numerical values for a and p are obtained from filta- parameter set 75 and Ex(v,|i) 
20 is quantization error matrix 79, such as Eo(v,|x) or EiV,|x) defined above. 

Filtered coefficient matrices 87 are transformed into filtered image-data 
matrices 88 comprising filtered image data terms denoted by rfs,rO,i), at operation 96, 
by the application of an inverse orthogonal transform in accordance with the matrix 
equation. 



[5v,,,(v./^)f 
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rfs.rG.i) = X S4r(V,H) X C 

Because of the overlapping procedure performed at operation 94, each filtered 
image-data matrix 88 contains more image data terms than is necessary to oi3tain 
reduced-noise digital image 39. Accordingly, image data terms lying only within an 
5 N' X N' core submatrix rk(m,n) of each filtered image-data matrix are extracted and 
combined to form a two-dimensional H x V reduced-noise image-data set 89 at 
operation 98, where 0 ^ m,n < N'-l , where N' = N-oo, and where co is overlap 
parameter 84. 

Each core submatrix rks,r(m,n) is obtained by deleting the image data terms in 
10 rows 0 through (^-1) and (N-— ) through (N-1), and the fihered image data terms in 

. . ■ 2 2 

colmnns 0 through (—-1) and (N-~) through (N-1) of a corresponding filtered 

2 2 

image data matrix rfsXj»i)- The relationship between core submatrix terms 
rksXn,m)and filtered iniage data terms in the coiresponding filtered image-data 
matrix rfs,r04) is given by the expression, 

15 , <>(y-(f)..-(f))='/..-C/.o 

Reduced-noise image-data set 89 is formed by combining the core matrix 
terms into a two-dimensional H x V array in accordance with the equation, 

SF(n+sN',m-4-rN') = rks,r(n,m). 

20 where 0 < m+rN' < H-1 and 0 < n+sN' < V-1. Reduced-noise image-data set 89, 

which corresponds to received image-data set 83, is reconstmcted, at operation 99, to 
form reduced-noise digital image 39, In comparison to conventionally-obtained 
received digital image 43, the effects of blocking artifacts attributable to 
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quantization have been reduced or eliminated iii reduced-noise digital image 39 as a 
consequence of filtering operation 95. 

Image Decoding Module — Aiternative Embodiment 

For image processing applications in which a transmission encoded data set 

5 103 has been provided by a conventional image encoding module, such as a module 
configured to output JPEG-compliant data, decoding is accomplished by means of . 
an alternative image decoding module 101, shown in Fig. 5, Typically, the 
conventional image encoding module provides a quantization table 1 05, but no 
quantization error matrix or filter parameters, via transmission medium 19. 

10 Accordingly, image decoding module 101 utilizes a quantization error table 109 as a 
. quantization error matrix, in operation 95, Filtering parameters tised in operation 95 
are provided by obtaining numerical values for aic and from a filter parameter set 
75' by means of a decoding parameter table, such as Table n. 

Transmission encoded data set 103 is converted into a series of modified 

15 coefficient matrices 85, by means of operations 92 and 94, as described above for the 
preferred embodiment. An estimated scaling factor 107, denoted by k', is obtained 
as the DC scaled quantization term (i.e., scaled quantization term Q(0,0)in the first 
row and first column) of quantization table 105, at operation 121.. Scaling factor 107 
is applied to filter parameter set 75' to produce numerical values for Ok and Pk in 

20 accordance v^th Table n. 



Tablen 

Values for a and P Given Estimated Scaling Factor k' 


k' = DC 










0 


0 


0 


8 < k' < 24 


1 


2 


2 


24 < k' < 32 . 


2 . 


4 


4 


k'>32 


. 3. 


6 


■ ^ 
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Scaling factor 107 is also applied to quantization-error table 109 from which 
an estimated quantization error matrix E/v,|Li), comprising a table of N x N 
noise-miask terms, is selected. The noise-mask terms contained in quantization error 
matrices E/v,jLi) are derived from empirical data and estimation methods and take 
5 into account various image attributes typically considered by an image processing 
operator. Quantization Error Tables HI through V are examples of such 
empirically-derived noise masks used for 8 x 8 frequency-coefificient matrices. 

Estimated quantization error matrix BJy,\i) and the numerical values 
obtained for ajc and Pk from filter parameter set 75' are applied with the filtering 
10 operation performed on modified coefficient matrix 85, at operation 95, to produce 
filtered coefficient matrix 87. Reduced-noise digital image 39 is obtsiined by 
execnition oi^ operations 96, 98, and 99, as in the preferred embodiment. 



Quantization Error Table III 
Scaling Factor = 2; Y Image-Data Band 



0.0 


0.6 


0.3 


0.3 


0.6 


0.8 


1.0 


1.0 


0.6 


0.6 


0.3 


0.6 


0.6 


0.8 


1.1 


1.2 


0.6 


0.6 


0.6 


0.6 


0.8 


1.0 


1.2 


1.2 


0.6 


0.6 


0.6 


0.6 


0.8 


1.1 


1.2 


1.1 


0.6 


0.6 


0.6 


0.8 


0.9 


1.0 


1.2 


1.0 


0.6 


0.6 


0.8 


1.1 


1.1 


1-1 


1.0 


0.8 


0.8 


0.8 


0.9 


LI 


1.1 


1.0 


0.8 


0.7 


0.8 


0.9 


1.1 


1.1 


0.9 


0.9 


0.7 


0.6 
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Quantization Error Table IV 
Scaling Factor = 8; U Image-Data Band 



0.0 


2.2 


2.2 


2.6 


2.7 


. 2.2 


1.7 


1.5 


2.2 


2.2 


2.2 


2,3 


2.3 


1.8 


1.4 


1.4 


2.5 


2.2 


2.3 


2.5 


. 2.1 


1.6 


1.3 


1-2 


2.7 


2.5 


2.6 


2.3 


1.7 


1.4 


1.2 


1.1 


3.1 


2.6 


2.2 


1.8 


1.5 


1-3 


1.1 


1.1 


2.7 


2.1 


1-7 


1.4 


1.3 


1.1 


1.1 


1.0 


2:1 


1.8 


1.5 


1.2 


1.1 


1,0 


1.0 


LO 


1.7 


1.5 


1.3 


1.1 


1.0 


1.0 


1.0 


1.0 



Quantization Error Table V 
' Scaling Factor - 24; V Image-Data Band 



0.0 . 


6.1 


5.4 


5.3 


4.2 


3.4 


2.9 


2.7 


6.1 


5.9 


5.0 


4.3 


3.5 


3.0 


2.6 


2.5 


6.1 


5.2 .. 


4.7 


41 


3.3 


2.7 


2.4 


2.4 


5.8 


4.8 


4.5 


3.5 


2.9 


2.5 


2.2 


2.2 


5.3 . 


: 4.3' . 


3.4 


2.8 


2.4 


2.2 


2.0 


2.0 


3.9 


3.3 ■ 


2.7 . 


2.3 


2.1 


2.0 


2.0. 


1.9 


3.1 


.2.7. 


2.3 


2.0 


L9 


1,8 


1.8 


1.8 


2.5 


2.3 


2.0 


1.8 


1.7 


1.7 


1.7 


1.7 



The present invention is advantageously adapted to provide an apparatus 
which accomplishes moderate levels of image data compression without incurring 
blocking artifacts in a more efficient method than is presently available in 
conventional image processing devices. While there have been described preferred 
5 embodiments of the present invention, it will be readily apparent to those skilled in 
the art that various changes and modifications may be made therein without 
departing from the invention, and it is intended in the wording of the appended 
claims to include such changes and modifications as would be encompassed by the 
true spirit iand scope of the invention. ; 
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What is claimed is: 

1 . A method for reducing the effects of blockuig artifacts attributable to 
quantization incurred in the transform image coding and compression of a 
two-dimensional image signal into a digital image, the degree of compression 
determined by a scaling factor k and a quantization table, and the image signal 
5 provided as a series of electrical signals, each electrical signal corresponding to a 
characteristic of an element of a two-dirhensional image, where the image elements 
have been configured as a two-dimensional H x V array, said method comprising the 
steps of: 

converting the series of electrical signals into a set of numerical values, each 
10 said numerical value quantitatively describing a feahire characteiristic of a 

corresponding image element, said numerical values further denoted by So(z,y) where 
0^y<H-l andO<z<V-l; 

formatting said set of numerical values into a plurality of N x N uhage data 
matrices identified by indices 'p' and *q', each said image-data matrix comprising 
15 image-data terms denoted by Sq.p(j,i), each said image data term comprised of a said 
numerical value determined in accordance with the relationship; 

Sq,p(j,i) = So(j+Nq,i+Np) 

where 0 2 ij < N-1; 

transforming each said image-data matrix into an N x N 
20 frequency-coefficient matrix comprising frequency-coefficient terms denoted by 
Sq,p(v,^), said Step of transforming each said image-data matrix accomplished by 
means of an orthogonal transform basis matrix C in accordance with the expression, 

Sq,p(V,|i) = C X Sci.p(j,i) X C*^; 

dividing each said frequency-coefficient term Sq,p(v,|Li) by a scaled 
25 quantization term denoted by Q(v,fi), said scaled quantization term obtained from 
the quantization table and modified by the scaling factor, to yield a plurality of 
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30 



35 



40 



45 



N. X N quotient-coefficient matrices comprising quotient terms denoted by Qu 
q,p(v,|x) derived in accordance with the expression, 



Qu,.p(v,/i) = 



So,p(V,M) 



rounding each said quotient term to a less precise value to yield a 
quantized-coefGcient matrix comprising quantized-quotient terms denoted by 
Qcq.p(v,p,) in accordance with the expression. 



Qc,,(v,;.) = roMnd^^^^^^^ 

subtracting each said quantized-coefficient term Qc q,p(v,iLi) from a 
corresponding said quotient term Qu q,p(v,ii) to form a plurality of N x N 
difference-coefficient matrices comprising difference terms Dcq,p(v,|i) derived in 
accordance with the expression. 



Dcqp(v,/z) = abs 



Sa.p(V>M) 

. i2(v,ju) ) 



— roimd 



deriving a quantization error matrix, comprising terms Eo(v,|i), by summing 
and averaging error terms, said error terms comprising functions of said 
difference-coefficient matrices; 

selecting a set of filter parameters, denoted by a and p; 

multiplying each said quantized coefficient term by a corresponding 
quantization term to yield a plurality of N x N mask-multiplied transfomi coefficient 
matrices coinprising terms denoted by R q,p(v,fi) derived in accordance with the 
expression. 
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applying an inverse orthogonal transform to said mask-multiplied transform 
coefficient matrices to yield a plurality of N x N received image-data matrices 
50 denoted by rq^p(j,i), in accordance with the inverse transform equation, 

r,,p(j,i) = X Rq,p(v,ti) X C; 

formatting said received image-data matrices into an H x V received 
image-data set comprising terms denoted by SR(z,y), in accordance v^th the equation, 

SR04Nq,i-FNp) = rq,pO,i) 
55 where 0 ^ i+Np ^ H-1 and 0<j+Nq^ V-1; 

forming said received image data set into a plurality of N x N overlapped 
image-data matrices comprising terms denoted by Vs^(j|,i), in accordance with the 
equation, 

Vs^,i) = srO+cos, i+©r); 

.60 transforming said overlapped image-data matrices into modified coefficient 

matrices comprising terms denoted by Svs,r(v,M.), in accordance with the equation, 

SVs,r(V,^) = C X Vs,r04) X 

converting said modified coefficient matrices into filtered coefficient 
matrices by means of said quantization error matrix and said filter parameters, said 
65 modified coefficient matrix comprising terms denoted by Sfs,r(v,|x), said step of 
converting said modified coefficient matrices performed in accordance v^ith the 
equation, 

5/,,(v,At) = [5v,Xv,M)]x [^^.^(^'At)? 



[^,.,(v,iU)f +a[£o(v,/i)f J ' 



transforming said filtered coefficient matrices into filtered image-data 
70 matrices in accordance with the transform equation, 
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rfs.rG,i) - X Sfs.r(v,|a) X C;and 

converting said filtered image-data matrices into a series of filtered electrical 
signals such that said filtered electrical signals can be configured into a 
two-dimensioiial H x V array of filtered image elements, each said filtered electrical 
75 signal corresponding to a characteristic of one said filtered image element. 

2. The mefliod of claim 1 wherein said quantization error matrix Eo(v,ji) 
is determined in accordance with the relationship 

3. The method of claim 1 wherein said quantization error matrix Eo(v,|i) 
is determined in accordance with the relationship 



4. The method of claim 1 wherein said orthogonal transform basis 
matrix C comprises a discrete cosine transfomi basis matrix. 

5. The method of claim 1 wherein said step of converting said filtered 
image-data matrices comprises the steps of extracting a core submatrix fi-om each 
siedd filtered image-data matrix and combining a plurality of said core submatrices to 
form said two-dimensional H x V array of filtered image elements. 

6. The method of claim 5 wherein said step of extracting a core 
submatrix comprises deleting image-data terms in rows 0 through (^-1) and (N-— ) 

■ 2 2 

through (N-1) of said filtered image-data matrix and deleting filtered image-data 
terms in colunms 0 through (^-1) and ) through (N-1) of said filtered image- 

2 2 

data matrix. 
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7. The method of claim 1 wherein co is set to — . 

. . 2 . 

8. The method of claim 1 wherein N is equal to 8. 

9. A method for reducing the effects ofblocking artifacts attributable to 
quantization incurred in the transform image coding and compression of a 
two-dimensional image signal into a digital image, the degree of compression 
determined by a scaling factor K and a quantization table, and the image signal 

5 provided as a series of electrical signals, each electrical signal corresponding to a 
characteristic of an element of a two-dimensional image, where the image elements 
have been Configured as a two-dimensional H >^ V array, said method comprising the 
steps of: 

transform iniage coding the two-dimensional H V array of image elements 
10 to form a coded image-data set by means of an orthogonal transform basis matrix, 
said step of transfomi image coding comprising a quantization operation; 

decoding said coded image-data set by means of said orthogonal transform 
basis matrix to form a decoded image-data set; 

converting said decoded image-data set into a plurality of frequency 
.15 coefficient terms by means of said orthogonal transform basis matrix; 

filtering said plurality of fi-equency coefficient terms by means of a filtering 
computation, said filtering computation comprising the step of multiplying said 
fi*equehcy coefficient terms with a coefficient filtering term to form a plurality of 
filtered frequency coefficient terms; and 
20 converting said filtered frequency coefficients into a reduced-noise digital 

image. 

10. The method of claim 9 wherein said step of converting said decoded 
image-data set comprises the steps of forming said decoded image-data set into an 
array of overlapped image-data matrices and converting said array of overlapped 
image-data matrices into an array of firequency coefficient matrices by means of said 

-21- 



wo 96/37077 



PCT/US96/06888 



5 orthogonal transform basis matrix, said frequency coefficient matrices comprising 
said frequency coefficient terms. 

11. The method of claim 9 further comprising the step of deriving said 
coefficient fihering term. 

12. The method of claim 1 1 wherein said step of deriving said coefficient 
filtering term comprises the step of deriving at least one filter parameter. 

13. The method of claim 12 wherein said filter plarameter is a function of 
said scaling factor K. 

14. The method of claim 1 1 wherein said step of deriving said coefficient 
filtering term comprises the step of deriving a quantization error matrix. 

. 15. The method of claim 9 viierein said orthogonal trtosform basis 

matrix comprises a discrete cosine transform basis matrix. 

16, The method of claim 9 wherein said step of converting said filtered 
. fi-equency coefficients comprises the steps of transforming said filtered firequency 

coefficients into filtered image-data terms by means of said orthogonal transform 
basis matrix and converting said filtered image-data terms into a series of filtered 
5 electrical signals such that said filtered electrical signals can be configured into a 
two-dimensional H x V array of filtered image elements to form said reduced-noise 
digital image, each said filtered electrical signal corresponding to a characteristic of 
one said filtered image element 

17, The method of claim 16 wherein said step of converting said filtered 
image-data terms comprises the steps of extracting a portion of said filtered image- 
data terms and combining said portion to form a two-dimensional H x V reduced- 
noise image-data set from which said reduced-noise digital image is formed. 

18, A method for filtering a two-dimensional decoded image signal such 
that the effects of blocking artifacts attributable to quantization are reduced, the 
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blocking artifacts arising in the decoded image signal as a consequence of there 
having been performed transform image coding, data compression, and quantization 

5 on an antecedent image signal, the antecedent image signal having been provided as 
a series of electrical signals, each electrical signal corresponding to a characteristic 
of an element of the antecedent image, where the compression operation utilized a 
scaling factor k and quantization terms derived frorn a quantization table, and where 
the decoded image signal has been configured as a two-dimensional H x V set of 

10 image-data terms denoted by Sr(z, y), said method comprising the steps of; . 
defining an overlap parameter, denoted by co; 

forming the decoded image signal set into a plurality of N x N overlapped 
image-data matrices comprising terms denoted by Vs,r(j4)^ in accordance with the 
relationship, 
15 Vs,r(i4) = SRO+CDs,i+a)r); 

transforming said overlapped image-data matrices into modified coefficient 
matrices comprising terms denoted by Svs,r(v,|X), by means of an orthogonal 
transform basis matrix C in accordance with the matrix equation, 

SVs,r(V,^) - C X Vs,r04) 

20 estimating the scaling factor k; 

determining filter parameters as a function of said scaling factor, said filter 
parameters denoted by a(K) and P(k); 

selecting a quantization error matrix, denoted by Eo; 
converting said modified coefBcient matrices into filtered coefficicfnt 
25 matrices by means of said quantization error matrix and said filter parameters, said 
modified coefficient matrix comprising terms denoted by Sfs,r(v,|a), said step of 
converting said modified coefficient matrices performed in accordance with the 
equation. 



5/;..(v,M) = [5V,,Xv,/x)]x 



j5v,.,(v,Ai)f +a[£o(v,At)]\ 
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30 transforming said filtered coefficient matrices into filtered image-data 

matrices, denoted by rfs^r(j,i), in accordance with the matrix equation, 

rfs,rC4) = C*^ X Sfs,r(v,^) X C; and 

converting said filtered image-data matrices into a series of filtered . electrical 
signals such that said filtered electrical signals can be configured into a 
35 two-dimensional H x V array of filtered image elements to form a reduced-noise 

digital image, each said filtered electrical signal conresponding to a characteristic of 
one said filtered image element. 

19 . The method of claim 1 8 wherein said orthogonal transform basis 
matrix C comprises a discrete cosine transform basis matrix. 

20. The method of claini 18 wherein said step of converting said filtered 
image-data matrices comprises the steps of extracting a core submatrix fi-om each 
said filtered image-data matrix and combining a plurality of said core submatrices to 
form a two-dimensional H x V reduced-noise image-data set firom which said 

5 reduced-noise digital image is formed. 

21 . The method of claim 20 wherein said step of extracting a core 
submatrix comprises deleting image-data terms in rows 0 through (—-1) and (N-— ) 

.22 

through (N-1) of said filtered image*data matrix and deleting filtered image-data 
terais in columns 0 through (^-1) and (N-— ) through (N-1) of said filtered image- 

. ■ ■ ■ • . -2 2 * ■ . 

5 data matrix. 

N ' 

22. The method of claim 1 8 wherein (O is set to — . 



[5v,,,(v,/x)r+a[£o(v,Ai)r ' 
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23. The method of claim 1 8 wherein said step of estimating a scaling 
factor K comprises the step of setting K equal to the DC scaled quantization term of 
said quantization table. 

24. The method of claim 18 wherein said step of determining filter 
parameters comprises the step of obtaining at least one of said filter parameters from 
a numerical table. 

25. The method of claim 1 8 wherein k < 8 and a(K) = P(k) = 0. 

26. The method of claim 1 8 wherein 8 < k ^ 24 and a(K), P(k) > 1 . 

* 

27. The method of claim 18 wherein 24 < k < 32 and a(K), p(K) > 2. 

28. The method of claim 18 wherein k > 32 and a(K), ^(k) ^3. 

29. The method of claim 1 8 wherein said step of selecting a quantization 
error matrix comprises the step of obtaining at least one quantization error term fiom 

. X a numerical table. 

30. A method for filtering a two-dimensional decoded image signal such 
that the effects of blocking artifacts attributable to quantization are reduced, the 
blocking artifacts arising in the decoded image signal as a consequencie of there 
having been performed transform image coding, data compression, and quantization 

5 on an antecedent image signal, the iantecedent image signal having been provided as 
a series of electrical signals, each electrical signal corresponding to a characteristic 
of an element of the antecedent image, where the compression operation utilized a 
scaling factor and quantization terms obtained fi*om a quantization table, and where 
the decoded image signal has been configured as a two-dimensional H x v set of 

1 0 image-data terms denoted by sr(z, y), said method comprising the steps of: 
converting said set of image-data terms into a plurality of frequency 
coefficient terms by means of an orthogonal transform basis matrix; : 
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filtering said plurality of frequency coefficient terms by means of a filtering 
computation, said filtering computation comprising the step of multiplying said 
15 frequency coefficiient terms with a coefficient filtering term to form a plurality of 
filtered frequency coefficient terms; and 

converting said filtered frequency coefficients into a reduced-noise digital 

image. 

31: The method of claim 30 wherein said step of converting said set of 
image-data terms comprises the steps of forming said image-data terms into an array 
of overlapped image-data matrices and converting said array of overlapped image- 
data matrices into an array of coefficient matrices comprising frequency coefficient 
5 terms bymeansofsaid orthogonal transform basis matrix. 

* 32. The method of claim 30 further comprising the step of deriving said 
coefficient filtering term. 

33. The method of claim 32 wherein said step of deriving said coefficient 
filtering term comprises the step of deriving at least one filter parameter. 

34. The method of claim 33 wherein said filter parameter is a function of 
the scaling factor. 

35. The method of claim 32 wherein said step of deriving said coefficient 
filtering term comprises the step of deriving a quantization error matrix. 

36. The method of claim 30 wherein said step of converting said filtered 
fi'equency coefficients comprises the steps of transforming said filtered frequency 
coefficients into filtered image-data terms by means of said orthogonal transform 
basis matrix and converting said filtered image-data terms into a series of filtered 

5 electrical signals such that said fihered electrical signals can be configured into a 
two-dimensional H x V array of filtered image elements to form said reduced-noise 
digital image, each said filtered electrical signal corresponding to a characteristic of 
one said filtered image element. 
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37. An image processing apparatus for reducing the effects of blocking 
artifacts attributable to quantization incurred in the transform image coding and 
compression of a two-dimensional image signal into a digital image, the degree of 
compression determined by a scaling factor and a quantization table, and the image 
5 signal provided as a series of electrical signals, each electrical signal corresponding 
to a characteristic of an element of a two-dimensional image, where the image 
elements have been configured as a two-dimensional H x V array, said apparatus 
comprising: 

means for applying an orthogonal transform basis matrix to the 
10 two-dimensional H x V array of image elements so as to form a coded image-data 
set comprising quantized terms; 

means for s^plying said orthogonal transform basis matrix to said coded 
image-data set so as to form a decoded image-data set; 

means for transform image coding said decoded image-data set into a 
15 plurality of frequency coefiBcient terms; 

V filtering means, operative on said frequency coefficient terms such that said 

frequency coefficient terms are multiplied by a coefBcient filtering term to form a 
plurality of filtered frequency coefficient terms; and 

means for converting said filtered frequency coefficients into a reduced-iioise 

20 digital image. 

38. The image processing apparatus of claim 37 wherein said means for 
transform image coding said decoded image-data set comprises means for forming 
said decoded image-data set into an array of overlapped image-data matrices and 
means for transform image coding said array of overlapped image-data matrices into 
5 an array of frequency coefficient matrices comprising said frequency coefficient 
terms. 
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39. The image processing apparatus of claim 37 fiirther comprising 
means for deriving said coefficient filtering term. 

40, The image processing apparatus of claim 39 wherein said means for 
deriving said coefficient filtering term comprises means for providing a quantization 
error matrix. 

41 ; The imag^ processing apparatus of claim 40 wherein said means for 
providing a quantization error matrix comprises a numerical table. 

42. The image processing apparatus of claim 37 wherein said orthogonal 
transform basis matrix comprises a discrete cosine transform basis matrix. 

43. The image processing apparatus of claim 37 wherein said means for 
converting said filtered frequency coefficients comprises means for transform image 
coding said filtered frequency coefficients into filtered image-data terms and means 
for converting said filtered image-data terms into a series of filtered electrical signals 

5 such that said filtered electrical signals can be configured into a two-dimensional 
H X V array of filtered image elements to form said reduced-noise digital image, 
each said filtered electrical signal corresponding to a characteristic of one said 
filtered image element. 

44. The image processing apparatus of claim 43 wherein said means for 
converting said filtered image-data terms comprises means for extracting a portion 
of said filtered image-data terms and meaiis for combining said portion to form a 
two-dimensional H x V reduced-noise image-data set from which said reduced-noise 

5 digital image is formed, 

45. An image processing apparatus for filtering a two-dimensional 
decoded image signal such that the effects of blocking artifacts attributable to 
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quantization are reduced, the blocking artifacts arising in the decoded image signal 
as a consequence of there having been performed transform image coding, data 

5 compression, and quantization on an antecedent image signal, the antecedent image 
signal having been provided as a series of electrical signals, each electrical signal 
corresponding to a characteristic of an element of the antecedent image, where the 
compression operation utilized a scaling factor and quantization terms obtained from 
a quantization table, and vs^here the decoded image signal has been configured as a 

10 two-dimensional H x V set of ims^e-data terms denoted by Sr(z, y), said apparatus 
comprising: 

means for transform image coding said set of image-data terms into a 
plurality of frequency coefficient terms by means of an orthogonal transform basis 
matrix; 

1 5 filtering means, operative on said frequency coefficient terms such that said 

frequency coefficient terms are multiplied by a coefficient filtering term to form a 
plurality of filtered frequency coefficient temis; and 

means for converting said filtered frequency coefficients into a reduced-noise 
digital image. 

46. The image processing apparatus of claim 45 wherein said means for 
transform image coding said set of image-data terms comprises means for forming 
said image-data terms into an array of overlapped image-data matrices and means for 
transform image coding said array of overlapped image-data matrices into an array 

5 of frequency coefficient matrices comprising said frequency coefficient terms. 

47. The image processing apparatus of claim 45 further comprising 
means for deriving said coefiScieht filtering term. 

48. The image processing apparatus of claim 47 wherein said means for 
deriving said coefficient filtering term comprises means for providing a quantization 
error matrix. 
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49. The image processing apparatus of claim 48 wherein said means for 
providing a quantization error matrix comprises a numerical table. 

50. The image processing apparatus of claim 45 wherein said means for 
converting said filtered frequency coefficients comprises means for transform image 
coding said filtered frequency coefficients into filtered image-data terms and means 
for converting said filtered image-data terms into a series of filtered electrical signals 

5 such that said fihered electrical signals can be configured into a two-dimensional 
H X V array of filtered image elements to form said reduced-noise digital image, 
each said filtered electrical signal corresponding to a characteristic of one said 
filtered image element 

51. The image processing apparatus of claim 50 wherein said means for 
converting said filtered image-data terms comprises means for extracting a portion 
of said filtered image-data temis and means for combining said portion to form a 
two-dimensional H x V reduced-noise image-data set from which said reduced-noise 

5 digital image is formed. 
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